The nature of the animacy organization in human ventral temporal cortex

The principles underlying the animacy organization of the ventral temporal cortex (VTC) remain hotly debated, with recent evidence pointing to an animacy continuum rather than a dichotomy. What drives this continuum? According to the visual categorization hypothesis, the continuum reflects the degree to which animals contain animal-diagnostic features. By contrast, the agency hypothesis posits that the continuum reflects the degree to which animals are perceived as (social) agents. Here, we tested both hypotheses with a stimulus set in which visual categorizability and agency were dissociated based on representations in convolutional neural networks and behavioral experiments. Using fMRI, we found that visual categorizability and agency explained independent components of the animacy continuum in VTC. Modeled together, they fully explained the animacy continuum. Finally, clusters explained by visual categorizability were localized posterior to clusters explained by agency. These results show that multiple organizing principles, including agency, underlie the animacy continuum in VTC.Comment: 16 pages, 5 figures, code+data at - https://doi.org/10.17605/OSF.IO/VXWG9 Update - added supplementary results and edited abstrac

What Body Parts Reveal About the Organization of the Brain

In this issue of Neuron, Orlov et al. show that the human occipitotemporal cortex contains regions responding preferentially to body part categories, such as upper limbs (hand, elbow), torsos, or lower faces (mouth, chin). This organization may reflect differences in the connectivity of these regions with other brain regions, to support the efficient processing of the different types of information different body parts provide.Psycholog

Category selectivity in human visual cortex:beyond visual object recognition

Item does not contain fulltextHuman ventral temporal cortex shows a categorical organization, with regions responding selectively to faces, bodies, tools, scenes, words, and other categories. Why is this? Traditional accounts explain category selectivity as arising within a hierarchical system dedicated to visual object recognition. For example, it has been proposed that category selectivity reflects the clustering of category-associated visual feature representations, or that it reflects category-specific computational algorithms needed to achieve view invariance. This visual object recognition framework has gained renewed interest with the success of deep neural network models trained to "recognize" objects: these hierarchical feed-forward networks show similarities to human visual cortex, including categorical separability. We argue that the object recognition framework is unlikely to fully account for category selectivity in visual cortex. Instead, we consider category selectivity in the context of other functions such as navigation, social cognition, tool use, and reading. Category-selective regions are activated during such tasks even in the absence of visual input and even in individuals with no prior visual experience. Further, they are engaged in close connections with broader domain-specific networks. Considering the diverse functions of these networks, category-selective regions likely encode their preferred stimuli in highly idiosyncratic formats; representations that are useful for navigation, social cognition, or reading are unlikely to be meaningfully similar to each other and to varying degrees may not be entirely visual. The demand for specific types of representations to support category-associated tasks may best account for category selectivity in visual cortex. This broader view invites new experimental and computational approaches.7 p

Independent Representations of Verbs and Actions in Left Lateral Temporal Cortex

Verbs and nouns differ not only on formal linguistic grounds but also in what they typically refer to: Verbs typically refer to actions, whereas nouns typically refer to objects. Prior neuroimaging studies have revealed that regions in the left lateral temporal cortex (LTC), including the left posterior middle temporal gyrus (pMTG), respond selectively to action verbs relative to object nouns. Other studies have implicated the left pMTG in action knowledge, raising the possibility that verb selectivity in LTC may primarily reflect action-specific semantic features. Here, using functional neuroimaging, we test this hypothesis. Participants performed a simple memory task on visually presented verbs and nouns that described either events (e.g., "he eats" and "the conversation") or states (e.g., "he exists" and "the value"). Verb-selective regions in the left pMTG and the left STS were defined in individual participants by an independent localizer contrast between action verbs and object nouns. Both regions showed equally strong selectivity for event and state verbs relative to semantically matched nouns. The left STS responded more to states than events, whereas there was no difference between states and events in the left pMTG. Finally, whole-brain group analysis revealed that action verbs, relative to state verbs, activated a cluster in pMTG that was located posterior to the verb-selective pMTG clusters. Together, these results indicate that verb selectivity in LTC is independent of action representations. We consider other differences between verbs and nouns that may underlie verb selectivity in LTC, including the verb property of predication.Psycholog

Review: Object vision in a structured world

In natural vision, objects appear at typical locations, both with respect to visual space (e.g., an airplane in the upper part of a scene) and other objects (e.g., a lamp above a table). Recent studies have shown that object vision is strongly adapted to such positional regularities. In this review we synthesize these developments, highlighting that adaptations to positional regularities facilitate object detection and recognition, and sharpen the representations of objects in visual cortex. These effects are pervasive across various types of high-level content. We posit that adaptations to real-world structure collectively support optimal usage of limited cortical processing resources. Taking positional regularities into account will thus be essential for understanding efficient object vision in the real world

Left occipitotemporal cortex contributes to the discrimination of tool-associated hand actions: fMRI and TMS evidence

Functional neuroimaging studies have implicated the left lateral occipitotemporal cortex (LOTC) in both tool and hand perception but the functional role of this region is not fully known. Here, by using a task manipulation, we tested whether tool-/hand-selective LOTC contributes to the discrimination of tool-associated hand actions. Participants viewed briefly presented pictures of kitchen and garage tools while they performed one of two tasks: in the action task, they judged whether the tool is associated with a hand rotation action (e.g., screwdriver) or a hand squeeze action (e.g., garlic press), while in the location task they judged whether the tool is typically found in the kitchen (e.g., garlic press) or in the garage (e.g., screwdriver). Both tasks were performed on the same stimulus set and were matched for difficulty. Contrasting fMRI responses between these tasks showed stronger activity during the action task than the location task in both tool- and hand-selective LOTC regions, which closely overlapped. No differences were found in nearby object- and motion-selective control regions. Importantly, these findings were confirmed by a TMS study, which showed that effective TMS over the tool-/hand-selective LOTC region significantly slowed responses for tool action discriminations relative to tool location discriminations, with no such difference during sham TMS. We conclude that left LOTC contributes to the discrimination of tool-associated hand actions

Independent representations of verbs and actions in left lateral temporal cortex

Verbs and nouns differ not only on formal linguistic grounds but also in what they typically refer to: verbs typically refer to actions, whereas nouns typically refer to objects. Prior neuroimaging studies have revealed that regions in the left lateral temporal cortex (LTC), including the left posterior middle temporal gyrus (pMTG), respond selectively to action verbs relative to object nouns. Other studies have implicated the left pMTG in action knowledge, raising the possibility that verb selectivity in LTC may primarily reflect action-specific semantic features. Here, using functional neuroimaging, we test this hypothesis. Participants performed a simple memory task on visually presented verbs and nouns that described either events (e.g., “he eats” and “the conversation”) or states (e.g., “he exists” and “the value”). Verb-selective regions in the left pMTG and the left STS were defined in individual participants by an independent localizer contrast between action verbs and object nouns. Both regions showed equally strong selectivity for event and state verbs relative to semantically matched nouns. The left STS responded more to states than events, whereas there was no difference between states and events in the left pMTG. Finally, whole-brain group analysis revealed that action verbs, relative to state verbs, activated a cluster in pMTG that was located posterior to the verb-selective pMTG clusters. Together, these results indicate that verb selectivity in LTC is independent of action representations. We consider other differences between verbs and nouns that may underlie verb selectivity in LTC, including the verb function of predication

Privileged access to awareness for faces and objects of expertise

Access to visual awareness for human faces is strongly influenced by spatial orientation: Under continuous flash suppression (CFS), upright faces break into awareness more quickly than inverted faces. This effect of inversion for faces is larger than for a wide range of other animate and inanimate objects. Here we asked whether this apparently specific sensitivity to upright faces reflects face-specific detection mechanisms or whether it reflects perceptual expertise more generally. We tested car experts who varied in their degree of car and face expertise and measured the time upright and inverted faces, cars, and chairs needed to overcome CFS and break into awareness. Results showed that greater car expertise was correlated with larger car inversion effects under CFS. A similar relation between better discrimination performance and larger CFS inversion effects was found for faces. CFS inversion effects are thus modulated by perceptual expertise for both faces and cars. These results demonstrate that inversion effects in conscious access are not unique to faces but similarly exist for other objects of expertise. More generally, we interpret these findings as suggesting that access to awareness and exemplar-level discrimination rely on partially shared perceptual mechanisms. (PsycINFO Database Recor

The Sight of Others' Pain Modulates Motor Processing in Human Cingulate Cortex

Neuroimaging evidence has shown that a network including cingulate cortex and bilateral insula responds to both felt and seen pain. Of these, dorsal anterior cingulate and midcingulate areas are involved in preparing context-appropriate motor responses to painful situations, but it is unclear whether the same holds for observed pain. Participants in this functional magnetic resonance imaging study viewed short animations depicting a noxious implement (e.g., a sharp knife) or an innocuous implement (e.g., a butter knife) striking a person's hand. Participants were required to execute or suppress button-press responses depending on whether the implements hit or missed the hand. The combination of the implement's noxiousness and whether it contacted the hand strongly affected reaction times, with the fastest responses to noxious-hit trials. Blood oxygen level-dependent signal changes mirrored this behavioral interaction with increased activation during noxious-hit trials only in midcingulate, dorsal anterior, and dorsal posterior cingulate regions. Crucially, the activation in these cingulate regions also depended on whether the subject made an overt motor response to the event, linking their role in pain observation to their role in motor processing. This study also suggests a functional topography in medial premotor regions implicated in "pain empathy,” with adjacent activations relating to pain-selective and motor-selective components, and their interactio